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ABSTRACT 

Word associations to 51 stimulus words selected from 
the Kent and Rosanoff stimulus list were obtained from 110 graduate 
and 75 undergraduate teacher trainees. Associations were analyzed so 
that comparisons between teacher-trainee associations and several 
adult normative collections could be made. Response homogeneity was 
found to increase significantly from 1910 to 1967, and undergraduate 
Ss were found to have significantly more response homogeneity than 
graduate Ss. Teacher trainees demonstrated a high degree of response 
homogeneity to the list of stimulus words. Although they are not 
significantly different in their associative habits from other adult 
populations, future research should examine the possible effects that 
response homogeneity may have on the language used in the classroom. 
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Abstract 



Word associatioas to 51 stimulus words selected from the Keut 
and Rosanoff stimulus list were obtained from 185 graduate and under- 
graduate teacher-trainees. Associations were analyzed so that com> 
parlsons between teacher -trainee associations and several adult 
normative collections could be made. Response homogeneity was found 
to Increase significantly from 1910 to 1967 and undergraduate 8s 
were found to have significantly more response homogeneity 
than graduate ^s. The findings were discussed In terms of the 
cumulative effect of "mass culture" on associations over time and 
the Impact that response conformity may have on the use and meaning 
of language In the classroom. 



Systeafttic Changes in Adult Word 'Association Horns 1910-1967: laplications 

for the Laaguage of the Classroom 



Robert H. Koff 
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by 



David H. Feldman 
Stanford University 



Intuitively, the language that teachers and students use in the 
classroom should be related to a variety of pupil performance 
characteristics. Bellack, et. al . (1966) examined the effects of 
language used in the classroom and were able to develop a list of 
rules for the language game of teaching. Smith and Meux (1960) 
Investigated the effects of the logic of verbal communication on 
pupil behavior, Getzels and Jackson (1962) investigated the relation- 
ship between teacher-student coimnunication variables and creativity 
and intelligence, and Taba (1964) developed a system for representing 
the impact of teacher verbal behavior on patterns of student cognitive 

ormance . Thus several investigations of teacher-student verbal 
interactions have shown that the "language of the classroom" is 
significantly related to patterns of student performance. 

The study of word associations represents the interaction of 
two old and active fields of research, the area of personality 
dynamics (or individual differences) and the area of cognition 
(or the various aspects of knowing). Recent word association research 
has been concerned with' the impact of "mass culture" on free 
associations as they are related to intelligence and social class 
(Entwisle, 1966), language development in children (Brown & Ber ko , 
1960), and systematic changes in associations of children over time 
(Palermo & Jienkins, 1964; Koff, 1965). 

Free association research has been addressed to the question of 
systematic changes in associations of adults (Jenkins & Russell, 

I960 ). In their comparison of adult norms, Jenkins and RusseU ■■ ■■. 
theorized that the effects of "mass culture," "other-directedness," 
and similar constructs used to characterize our culture would have 
significant effects upon associations over time. Their studies 
showed that there is a general tendency for the frequency of primary 
(common) responses to increase with time, that words used as responses 
to stimuli tend to change slowly but systematiclly over time (with the 
highest -ranking responses having the highest stability), and that 



Koff 



- 2 - 

there ves e significant tendency for superordinate responses to 
decrease with time. Jenkins and Russell are the only investigators 
who have explored the issue of systematic change in free associations, 
but their findings were based on groups of adults who did not plan 
to become teachers. 

The purpose of the present inquiry was to examine the word 
associations of a group of teacher -trainees and to relate their 
associative response patterns to the potential effect they may have 
on the use and meaning of language in the classroom. Within the 
context of this paper teachers are viewed as primary transmitters of 
the culture and as such are significant determiners of the language 
used in the classroom. This paper presents first the associations of 
a group of teacher- trainees to a standardized list of stimulus words 
selected from the Kent and Rosanoff (1910) stimulus list. Second, 
differences in associative patterns between college education 
major undergraduates and Master of Arts in Teaching graduate students 
are examined. Third, conq>arisons of teacher- trainee associations with 
several adult normative collections are made. In conclusion, 
speculations are made as to the effects that "response homogeneity" 
may have on the use and meaning of language for students in the 
classroom. 

Method 

The sanq>le consisted of a total of 185 education students divided 
as follows: 75 undergraduates who attended a large state college 

and 110 Master of Arts in Teaching graduates who attended a private 
university. Ss completed the test materials during their regular 
educational psychology classes in the fall of 1967. Each 8 was given 
a test booklet which contained 100 stimulus words from the Kent and 
Rosanoff stimulus list. However, only 51 words selected from the 
stimulus list were analyzed for the present study. The criteria 
for selection of these stimulus words were those employed by Koff (1965). 

Test conditions and instructions were kept as similar to the 
Russell and Jenkins (1960) study as possible. The following instructions 
were read aloud to the £s. 
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This is one of the studies of verbal behavior being done at the 
Stanford Center for Research and Develofmient in Teaching. This 
particular experiment is on free-association. 

Do not write your name on the outside of the paper passed to you. 

When you open these sheets, you will see a list of 100 stimulus 
words. After each word, write the first word that it makes you 
think of. 

Start then to go on to the next word. 

Use only a single word for each response. 

Do not skip any words. 

Work rapidly until you have finished all 100 words. 

When you are through, turn your paper over and write on the 
back the letter that appears on the board at that time. 

Are there any questions? 

Ready? Now go. 

In order to place moderate time pressure on Ss the letter "A" 
was written on a blackboard at the front of the room at the beginning 
of the test period, and succeeding letters were placed on the black- 
board a five -minute intervals. 

Test administration in the present study differs in certain respects 
from previous word association studies. The major difference in test- 
ing procedure was that Ss were not required to put their names on 
their test booklets. It was felt that this procedure would serve to 
decrease response homogeneity because of the anonymity it guaranteed 
each Ss were asked after they had completed the questionnaire 
whether it made any difference to them that they had not put their 
names on their test booklets. Ss were unanimous in their agreement 
that they would not have responded differently had they been asked 
to write their names on the test booklets. It is recognized that 
variations in test procedures may have an effect upon response pro- 
duction, but studies by Clousing (1927), Boyer and Elton (1958) 
and Jenkins and Russell (1960) suggest that oral- individual or group 
administration procedures have had little effect on responses. 
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Results 

The date were analyzed in order to answer the following questions: 

(1) Do state college education Ss show more response homogeneity 
than university graduate teacher -trainees? (2) Is the trend toward 
increased response homogeneity continued in a sample of teacher- 
trainees? (3) Is response homogeneity more pronounced for teacher- trainees 
than for the general adult population? 

Table 1 shows the stimuli, primary responses and average percentage 
of primary, secondary and tertiary responses for the graduate and 
undergraduate teacher -trainees. Out of a total of 51 stimulus words, 

13 showed primary response changes. That is, undergraduate and 
graduate teacher -trainees responded with the same primary response 
a total of 38 times. From the percentage of the total nunher of 
associations that the primary, and primary, secondary and tertiary 
responses represent it can be seen that there is a high degree 
of response agreement between the two groups even though the under- 
graduate Ss show more response homogeneity. The primary responses 
for the 51 stimulus words shown in Table 1 accounted for 39.3 and 
42.7 percent of the responses for the graduate and undergraduate £s 
respectively. These average percentages are not significantly dif- 
ferent from each other. For the graduate Ss the primary, secondary 
and tertiary responses accounted for a total of 52.9 percent of the 
total nund>er of responses. For the undergraduate Ss this figure 
was 61.5 percent, a significant (p ^.05) increase of 8.6 percent 
(Johnson, 1949, pp. 93-97). 



Insert Table 1 About Here 

Table 2 shows the average percent of primary, and primary, 
secondary and tertiary associations for eight normative collections 
from 1910 to 1967. It is clear from Table 2 that the trend toward 
response homogeneity has been continued and replicated in the present 
sample. The average percent primary response in 1910 and 1967 was 
25.2 and 41.3 respectively; an average increase of 16.1 percent. 

The average percent primary, secondary and tertiary responses was 




Koff 



> 5 - 

1910 And 57*4 in 1967* Thus thArc hss bcsn sn AvcirsgA 
IncreAse in priatry, secondary and tertiary response homogeneity 
of some 12*2 percent over the last 57 years. 

The Russell and Jenkins 1952 sample shows slightly more response 
homogeneity than the 1967 sample (an average increase of 1.6 percent 
in the primary response category and 4.8 percent in the primary, 
secondary and tertiary category). These differences are not significant 
and may be attributable to variations in test administration. 

For example, Russell and Jenkins required Ss so write their names on 
test booklets, thus making the testing procedure more similar to 
individual administration than was the case in the present study. 

The differences are, however, so small that they do not seem to 
represent any systematic evidence that would indicate that response 
homogeneity in 1967 has increased significantly from 1952. 



Insert Table 2 About Here 

Table 2 also shows that teacher- trainee associations do not 
deviate significantly from earlier normative collections. However, 
the data do illustrate the fact that teacher -trainee associations 
are consistent with respect to the trend toward increased response 
homogeneity over time. To be more confident of this finding, however, 

teacher -trainees should be compared with more recent adult control 
groups . 

Discussion 

The results of this study have implications for issues of concern 
to investigators of word association patterns and to educators. The 
study showed that teacher -trainees are, on the average, as homo- 
geneous in their associative responses as other adult populations 
sampled in the past and that undergraduate state college Ss are 
significantly (p^.05) higher in response homogeneity than university 
M.A.T. Ss. The study also showed that there is a general trend toward 
increased response homogeneity over time, but that the data collected 
in the present study reflected no significant increase in the general 
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tendency for Increased response homogeneity. In sunnary, response 
homogeneity has remained at about the same level since Jenkins and 
Russell's 1952 study of University of Minnesota students. 

The finding that teacher- trainees in a graduate education pro- 
gram show significantly less response homogeneity than state college 
undergraduates is consistent with earlier results reported by Kent 
and Rosanoff (1910). In their study Kent and Rosanoff found that 
more highly educated £s made less use of popular response words 
than less veil educated £s. However, the present finding is in- 
consistent with data interpretations made by Jenkins and Russell 
(1960). It is possible that the results for the present sample 
were due to factors other than education level; intelligence, age, 
or subtle differences in testing procedures may account for the 
differences found. 

Perhaps an asymptote has been reached with respect to homo- 
geneity of associations to this particular list of stimulus words. 

It would appear, however, that there is still room for greater response 
homogeneity since about 60 percent of the more .recent adult word collections 
gave similar primary, secondary and tertiary responses. The years between 
1910, 1925-1933, and 1952-1967 could be viewed as single time periods, 
with each study conducted during these periods serving as independent 
replications of the original. Although the numl^r of years between 
studies has not been consijtent, greater differences between samples 
are to be found when the number of years is increased between them. 

The present study has not provided evidence which would support 
the "mass culture" hypothesis advanced by Jenkins and Russell. 

Cross-cultural studies of association patterns from countries whose 
populations are exposed to varying degrees of "mass culture" are 
needed. Such studies ought to confirm the hypothesis that the greater 
the degree of exposure to "mass culture," the more likely there will 
ben increased associative response homogeneity. Entwisle (1966) 
has studied word associations of Amish children, but the stimulus 
words used in her study do not permit conqparison with earlier samples. 

The results of this study show that teacher-trainees demonstrated 
a high degree of response homogeneity to a selected list of stimulus 
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words. Although teacher -trainees are not significantly different in 
their associative habits from other adult populations, future 
research should examine the possible effects that response homo- 
geneity may have on the language used in the classroom. Teachers 
should be made aware of the high associative response probabilities 
attached to certain combinations of verbal stimuli and be trained 
to change their verbal behavior in order to maximize the effects that 
such associative links may have on perceptual factors in word 
recognition and meaning. 

It would seem that we are now in a position to inquire into xdiat 
the effects of response homogeneity may have on pupil performance 
characteristics. What effect may response homogeneity have on such 
constructs as creativity, ideational fluency, short and long term 
memory, transfer, etc.? What relationships are there between social 
class variables and response homogeneity as they are manifested in 
the utilization of language in the classroom? 



Table 1 

Stimuli, Primary Responses and Average Percentage of Primary and Primary, 
Secondary and Tertiary Responses for 185 Graduate and Undergraduate Education Students 



i 



u 

•H d 
04 rs 

eo>v 
c M 

•H « M 
01 

« C*H 
X OW 
O M 
09 O O 
Wpitr* 



9 

00 

C 

o 

a 

09 

«,e 

c 

•rl 

JA U 

St 

CO U 
COiAc 



0) O 

00 f -4 

c •-< 
o 

Cu H 
00 

S5 






U 

q| 

M 

P4 (8H 

«)>» 

C M 
•H e.M 
^ *o « 
S 

X o 
o w 
09,0 o 

CO|C/I H 



o 

CO 

d 

o 

a 

oo 

PC 

60 N-' 

c 

•H ►» 

00 M 
CO| 04 



0) 

CO ID 

S'' 

CU -I! 
CO 



ERIC 



CO 

9 

f-4 

I 

4J 

CO 



oooooooooooooooooooooooooooo 

csr^cx)mOr^ir»r^r^5>'COvoo>'<tt-4oOi-4r^i/^in»or^>4’'S''>^0»^^ 



^OOOOOOOOOOOOOOOOOOOOOOOOOOOO 

<^iv60ino^<n*^oor^ooOsocMo%o%^i.'%ooooo%r^o^eo<o«^OvO'^ 
r^sOfor>^<^<^c»9i-4cnm«^i-<cn<*9 incnsfcoi-4coi-4cn*-<tnvoc»9»-i 



g 

rH 


a 


>k 


1-4 


o 


1-4 


0» 


4J 




>c 


CO 


o 



8 



o 

fd 



4J 

u 



eMO>eMm*d’00»ocni-4*-iC7soOco.^Ococ^vC/OcnOir»r^r^c»900 



cn (X> 9k C4 00 

00 



«n m \o 

0>9iirk9>irkir»v0«9k0 



r^<nkor^»^m«-«t-ir^o<no> 0 \oinror^ 

cor^r^evir^r-r^ocnvovor^kor^r^vocn 



OkO%ooooo<ncMi-4ooi-«sl'<omsomr-4oo«-«ooeMoO'^<oc>iooosr 

• •••••••• 

S *jfr^o%oooo'0\i-«mcMN09'Ckio\r^c>iio»-*r^ir>oooococM<no50 
OOCOOO<^JC'i«9'^*^vOiA*^'4’'9 



JC S 

M -U 4J d 1-4 

•H J 3 «-4 ® *d 

« 60 « a e M 

JS « O 

o ij s :s 



d 



•o 

o 



j jg 6 
CO 9B |ki 



JS 
60 . 
•H O 

s s 



0) 



0) l» 

4J t-4 o - 
t 4 k -4 « ^ 

^ e V <0 
Shah 



M 

d 

o 

CO 





>• JB 


•o 








U 4J ' 


a 


U 




a 


4J o s 


O V 


9 


d 


Id 


« Q 5 


M d 6s 3 


9 






u 


J3 1-4 O o 


> 


o 


n 


04 CO W 


H A A ^4 


CO 


Pi 



A H 









. 






>> 






CO 




d 








1-4 






CO 




•.4 








(M 


V 




0) 


60 


d 










fH 




d 


e 


ij 


9 


M 


41 


a> >4 


4J 4J d 




X Q> 


•H 


d 


Vt 


o 


M 


4* H 


e «' d 


*o d AJ 


u d e *M 


U 


d 


d 


« 


0 


■u 3 


9 0 


1-4 o T4 


•H 3 a o 




£ 


Q 


f-4 


43 


d j; 


9 JS o 


O k-4 


CO X Q A 


M 


X 


X 


A 


CO 


A o 


A SB :s 


O A X 



d 

«M 



• J= 



« 



JS 

4J 

$4 

s 



Soldier War 24.7 45.2 15.0 31.0 





UNDERGRADUATES GRADUATES 






b 

•H*Q 

M 

Oi «rc 

00 >s 
C M 
•H « M 
Ji’O b 
« C*H 
SOW 
U M 
OB 0) 0) 
CO|»E-l 



« 

OS 

C 

o 

a 

»,e 

£ >. 
M 

Si 

CO Ki 
co|Pl 4 



o ooooooooooooooooooooo 

• • * * * * * * ' * * * * * * * 

■ 4 * r-ioocn»-ir**a'->i^<y‘vocMr>.ovvovo^«^^ojoojg 



0) o 

CO f-4 

C »-c 
O 

P. K 

CO 

« Z 



M 

cd 

E 

•H'O 

P 4 (drs 

bQ>% 

C M >s 
•H (d M 
<d 

cd C*H 
sow 
U M 
OB 0) 0) 
CO|MH 



0) 

CO 

C 

o 

a 

CO 

eS ^ 

«,e 

•H >, 

^ W 

(d (d 

S E 

•H 
CO w 
co|a« 



o ooooooooooooooooooooo 

CM ^ in 00 CM 

CM CM <t »n »-• 



• »«»•••••••••••• ___ 

' oo^oost’ 000 'cnr^oooooi 0 ^^cM^in<;oocM 



0) 

o 

C 

o 

a 

tt 

£ 



m 

II 



0) 

:3 

f-H 

i 



ERIC 



CO 



*d 

•H 

A 



■§ 

3 



M 

0> 



M 

4 

a 



0 

CO 

0 

1 



CM vO 



moocoinooOr^cMcr\<}-vO'PO\r^"«^in»~j'<l'CMootn 
- cnc*-cocncMincovocncMcocMin»^cM*n»^' 0 *^ 



4» 

U 
0 

*J w 



U 

0) 



(0 



M 

wx)a)Hw'-'a»c 
wpm^mm >dM*- 4 Ccowq).Ch’dcu'ioa)a) 
WiW*dWM M*-c >vOO‘H9hM-l OOOCflSO o.cdai^ 
4 )oo 0 *> 4 <d<d^of<dO 0 o*H<Hwoa)O 0 <d 
» 4 C 0 PiMOQOC 0 fx<C 0 ZP<ZC 0 H* 4 C 0 i 4 P 40 $O'U 



to ^ 

?d 0*0 wo. 

^ *d •-< <0 j 6 01 o 



h 4) 

U 01 M 

to to B « 

e d 5 9 



w 

0 ) to 

M^W^WW I 4 I>I K w ^ w •ww-^r -1 M Cw 
Cd(d 0 l( 4 O‘Hjd*HdQ 4 C 7 * 5 Q'H 0 fO 9 dWfMj 3 



M 

w 

O 9 



W 

>v W 0) 

d > d 0) w 

O fO O «H <H 



01 

CO 

0 ) 

0 ) 



as 

N 

m 



CO 

CO 



c>Jcnrv<i-r^f- 4 CMf« 40 \Ocooo\\ocMoocncnco^t^o tn 

• ••••••••••••••••••••* * 

mmsl'cnr^oovocMcO'tfmmr^cMinin^i^inOjden ^ 

^r^csiinoor^‘ntntnr^r^vo^n-<f'Ocn*nvo<nr^cn so 



o\ooc^<i’cnif\r-^<tr-*cs^\£ 3 (Dr>-^oor-^asco<vtinf^ n* 



CM 



4J 

c 

01 

0 
M 

£ 

01 






« 

01 

•H 

M 

0 

00 

01 
4J 
4 
U 

01 

« 

c 

0 

CL 

m 

01 
u 

Ps 

M 

4 

•H 

4J 

M 

4 

4J 

•§ 

4 

Ps 

4 

•g 

O 

0 

01 

CO 



Ps 

u 



u 

Cl 

C 

01 

01 

B 

01 

JO 



4J 

c 

01 

0 

01 • 

pd 01 
4J o 
d M 
0> 0) 
U CL 



4J 

CO 



4J 

ca 



4 4 
%i H 



cd 

g 



0) 0> 
x: M 
w w 

o o 
w w 

(w 4:1 

(W <M 

o o 

•o -d 

0) 0) 

"S "§ 

9 9 

5 o 
otf (d 



in 

s>S, 

ol 

w <u 

4J 

01 4 

0 3 
d *0 

01 4 
M U 
4 00 
44 ^ 
44 01 
•H TJ 
*d C 

3 

4J 

d 

4 d 

U 4 

•ri 

IM 0) 
•pC W 
d Cd 

to 9 

•rl >9 
01 Cd 
M 

o to 

u 

d 

C 9 <U 

Ki 4) 

« 2 
0) 01 
X) 



t-l CM ♦ 



iJ 

CO 



Kbff 



Table 2 



Average Per Ceat of Priaary and Prlaary, Secondary and Tertiary 
Aasoclatlona for Eight Adult HOraative Collections ; ISlO'lSb? 



Sample 


Year 

Collected 


M » 


Average Per Cent 
Primary Response 


Average Per Cent Prlma 
•P Secondary •!> Tertiary 
Response 


Kent/Rosanoff 


1910 


1000 


25.2^ 


45.5 


O'Connor 


1925 


1000 


35.1 


55.4 


Schellehberg 


1927 


925 


28.8 


48.6 


Keene 


1933 


500 


38.1 


57.7 


Russe 11/ Jenkins 


1952 


1008 


42.9 


62.2 


Tresselt 


1959 


108 


40.1 


58.7 


Koff 


1961 


122 


40.2 


59.2 


Koff/Feldman^ 


1967 


185 

1 


41.3 


57.4 



!• Average percentages based on a sample of 51 stimulus words from 
the Kent'Rosanoff list. Criterion for stimulus inclusion was 
the same as that employed by Koff (1965). 

2. Rounded to nearest tenth of a per cent. 

3. Sample consists of 185 education students divided as follows: 

75 undergraduates who attended a large state college and 110 
Master of Arts in Teaching graduates who attended a private 
university. 
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